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(57) A database management system having a dropped table recovery flag. If the dropped table recovery flag is on, at 
the time that a table is dropped an entry will be made in a dropped table history file. The dropped table history file 
contains a timestamp of the time of table drop, a unique dropped table identifier, and table definition information. The 
system includes a command to permit the table space of a dropped table to be restored and rolled forward to the point 
of the dropped table drop. The restored and rolled forward dropped table data is written to a flat file. The flat file data 
is loaded into a recreated table in the current table space to recover the dropped table. 
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5 Adatabaseraanagementsystemhavingadroppedtablerecoveiyflag. If the dropped table recovery 
flag is on, at the time that a table is dropped an entry will be made in a dropped table history file. 
The dropped table history file contains a timestamp of the time of table drop, a unique dropped table 
identifier, and table definition information. The system includes a command to permit the table 
space of a dropped table to be restored and rolled forward to the point of the dropped table drop. The 
10 restoredandrolledfowarddroppedtabledataiswrittentoaflatfile. The flat file data is loaded into 
a recreated table in the current table space to recover the dropped table. 
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FIELD OF THE INVENTION 

The present invention is directed to an improvement in database systems and in particular to the 
recovery of tables dropped from databases. 

BACKGROUND OF THF INVENTION 

In relational databases, data is organized into tables. A collection of such tables in a database is 
referred to as a table space. Database users sometimes inadvertently delete, or drop, a table from a 
table space. Typically, a database management system (DBMS) does not permit undelete of the drop 
action: once the table drop is committed, the table's data is permanently deleted and cannot be 
brought back by way of such a command as an undelete of the drop statement Instead, the data must 
be restored from a backup and then the data rolled forward by replaying stored transactions on the 
data, a potentially slow process. 

In certain DBMS environments, such as DB2™, recovering a dropped table is made even more 
difficult by the fact that a table space restore followed by a roll forward of the table space to a point 
in time prior to the drop cannot be done. This restriction means that to roll forward to recover a 
dropped table, the entire database, and not only the effected table space, must be rolled forward. 
This restriction on the roll forward of the table space is due to the minimum recovery time property. 
A table space must be rolled forward to at least the minimum recovery time so that is synchronized 
with the information in the system catalog tables. The minimum recovery time is updated when DDL 
statements are executed against a table space, or against tables in a table space. 

The minimum recovery time will be later than the time at which the table was dropped. Because of 
this fact, it is a requirement in typical DBMS environments that the user must recover the entire 
database. This means that the entire database becomes unavailable to other users while the recovery 
and rollforward of the database is being carried out. It is typically slower to perform the recovery 
and restore on the entire database than a recovery and rollforward on the effected table space, only. 
CA9-99-023 , 
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The only means in which a dropped table can be currently recovered in many relational databases, 
such as DB2™, is through a database restore followed by a database roll forward to a point in time 
justpriortothetabledrop. As indicated above, such an approach will make the database as a whole 
unavailableto users. Itmayalso be difBcult to pinpoint when a table was dropped and therefore data 
will often be inaccurately retrieved due to uncertainties about when the table in question 
dropped. In addition, the structure of the table may no longer be accurately known. 



was 



It is therefore desirable to have a DBMS in which tables which have been dropped may be recovered 
without the need to recover and roll forward the entire database and which permits the point at which 
the table was dropped to be determined with some accuracy, as well as to determine the structure of 
the table at the time of the drop. 

SUMMARY OF THE INVENTION 

According to one aspect of the present invention, there is provided an improved database 
management system. 

According to another aspect of the present invention, there is provided a database management 
system comprising one or more table spaces, each table space containing one or more tables having 
table definition attributes, means for generating, for a dropped table in a selected table space, a time 
stamp reflecting the time of drop and a unique table identifier, a dropped table history means for 
storing the table identifier, the time stamp and the table definition attributes for the dropped table, 
means for restoring and rolling forward the selected table space containing the dropped table to the 
time reflected in the time stamp by replaying a first set of stored transactions up to the time reflected 
in the time stamp, means for copying the data from the dropped table in the rolled forward selected 
table space to a storage data structure, means for updating the selected table space to a desired 
current state, means for accessing the table definition attributes for the dropped table, in the dropped 
table history means, to create a new table in the table space, and means for loading the data in the 
storage data structure into the new table. 
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According to another aspect of the present invention, there is provided the above system further 
comprising a dropped table flag for enabling dropped table recovery for a selected table space 
whereby the storage of the table identifier, the time stamp and the table definition attributes for the 
dropped table are conditional on the dropped table flag. 

According to another aspect of the present invention, there is provided the above system in which 
the means for updating the selected table space to a desired current state comprises a user-defined 
time up to which user-defined time a second set of stored transactions after the time reflected in the 
time stamp are replayed against the selected table space. 

According to another aspect of the present invention, there is provided the above system further 
comprising a means for storing a current state of the selected table space and in which the means for 
updating the selected table space to a desired current state further comprises a means to retrieve the 
stored current state of the selected table space. 



According to another aspect of the present invention, there is provided a computer program product 
for use with a computer comprising a central processing unit and random access memory, said 
computer program product comprising a computer usable medium having computer readable code 
means embodied in said medium for managing a database, as described with respect to the above 
systems. 



According to another aspect of the present invention, there is provided a method for recovering a 
dropped table in database management system comprising one or more table spaces, each table space 
containing one ormoretableshavmgtabledefinition attributes, the method comprising the following 
steps: 

(a) generating, for a dropped table in a selected table space, a time stamp reflecting the time 
of drop and a unique table identifier, 

(b) storing the table identifier, the time stamp and the table definition attributes for the 
dropped table in a dropped table history data structure, 
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(c) restoring and rolling forward the selected table space containing the dropped table to the 
time reflected in the time stamp by replaying a first set of stored transactions up to the time reflected 
in the time stamp, 

(d) copying the data from the dropped table in the rolled forward selected table space to a 
storage data structure, 

(e) updating the selected table space to a desired current state, 

(Qaccessmgmetabledefinitionattributes forthe dropped table, in the dropped table history 
data structure, to create a new table in the table space, and 

(g) loading the data in the storage data structure into the new table. 

According to another aspect of the present invention, there is provided the above method further 
comprising the stepof setting a dropped table flag for enabling dropped table recovery for a selected 
table space whereby the storage of the table identifier, the time stamp and the table definition 
attributes for the dropped table are conditional on the dropped table flag being set. 
According to another aspect of the present invention, there is provided the above method in which 
the step of updating the selected table space to a desired current state is dependent on a user-defined 
time up to which user-defined time a second set of stored transactions after the time reflected in the 
time stamp are replayed against the selected table space. 

According to another aspect of the present invention, there is provided the above method further 
comprising the step of storing a current state of the selected table space prior to restoring and rolling 
forward the selected table space and in which the means for updating the selected table space to a 
desired current state further comprises the step of retrieving the stored current state of the selected 
table space. 



According to another aspect of the present invention, there is provided a computer program product 
tangibly embodying a program of instructions executable by a computer to perform the above 
method steps. 
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Advantages of the present invention include the ability to restore and rollforward the table space of 
the dropped table without having to restore the entire database. In addition, the dropped table history 
records a timestamp for the drop of the dropped table to permit the rollforward to the drop of the 
table to be carried out with some accuracy. The structure of the table which has been dropped is also 
available for use in the recovery of the table. 

BRIEF DES CRIPTION OF THE DRAWINGS 

The preferred embodiment of the invention is shown in the drawings, wherein: 

Figure 1 is a block diagram showing the processing of the table space to recover a dropped 

table, in accordance with the system of the preferred embodiment. 

In the drawings, the preferred embodiment of the invention is illustrated by way of example. 

It is to be expressly understood that the description and drawings are only for the purpose of 

illustration and as an aid to understanding, and are not intended as a definition of the limits of the 

invention. 



DETAILED DESCRIPTIO N OF THE PREFERRED EMBODIMENT 

Referring to Figure 1, there is a block diagram showing the processing of a table space to 
recover a dropped table. Pre-drop table space 10 represents a table space in a database which pre- 
drop table space 10 is in a state immediately preceding the point of commitment for drop table 
command 12. In the preferred embodiment, the database is a relational database with the DB2™ 
DBMS, which implements SQL. The system of the preferred embodiment permits a user to turn on 
a dropped table recovery flag. A sample SQL command for an example table space tsl is: 

alter tablespace tsl using dropped table recovery on 

If this flag is turned on for a table space, the system of the preferred embodiment will create an entry 
in the data structure of dropped table history 14, when a table (ts 1 , in the above example) is dropped 
fiom pre-drop table space 10. Dropped table history 14 records a dropped table ID, an unique 
identifier for the dropped table. Dropped table history 14 also provides a timestamp which reflects 
the time at which the dropped table was dropped fiom the table space, as well as information about 
CA9-99-023 , 
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the structure of the table (table definition attributes). The option to record an entry in dropped table 
history 14 is table space specific. In the preferred embodiment, the flag may be queried in the 
syscattablespaces catalog table. There is a drop_recovery column which may be queried. The flag 
may be turned off and on by the user as required. When a table is dropped in the system of the 
preferred embodiment, the status of the flag is determined by the system and if the flag is on, then 
information about the dropped table is stored in dropped table history bb. 

In the system of the preferred embodiment, dropped table history 14 may be accessed by the LIST 
HISTORY DROPPED TABLE command. This command returns the dropped table ID, timestamp 
of the drop, and information about the structure of the table. An example of the command for the 
database testdb is as follows: 

list history dropped table all for test_db 

After accessing dropped table history 14 in this way, the user of the system of the preferred 
embodiment may then restore the table space. An example of such a command for table space tsl 
in database test db is: 

restore db test_db tablespace (tsl) 

InFigure 1, post-drop tablespace 16 represents the state of the table space after drop table command 
12 has been committed. It is expected that a number of transactions (not shown) will have been 
processed and that post-drop table space 1 6 may differ significantly from the state of pre-drop table 
space 10. 



Figure 1 shows the execution of restore command 18. This results in restored table space 20. 
Restored table space 20 must pre-date pre-drop table space 10. The user then uses the rollforward 
commandmmesystemofmeprefOTedembodimentto replay stored transactions 22 against restored 
table space 20. The system of the preferred embodiment permits the user to stop the rollforward of 
restored table space 20 at the timestamp found in dropped table history 14 for the table which was 
inadvertently dropped. The rollforward command of the preferred embodiment permits the user to 
CA9-99-023 * 



CA 02279028 1999-07-29 



specify that the rollforward is to stop at the drop point for a table with a given dropped table ID. In 
Figure 1, transactions 22 are shown being played against restored table space 20, up to the point 
indicated by dropped table history 14. The result is the pre-drop table space 24. The state of pre- 
drop table space 24 is intended to be materially equivalent to the state of pre-drop table space 10. 
The system has effectively permitted the recreation of the table space to the state of pre-drop table 
space 10, to permit the data from the dropped table to be extracted from the table space as it existed 
immediately prior to the drop table command 12 being committed in the system Once the 
appropriate transactions have been replayed against restored table space 20 to create pre-drop table 
space 24, a copy of the dropped table is made in flat file 26 

To accomplish this the user specifies a file location and the table data as it existed prior to drop will 
be written to the file as a flat file with ascii delimiters. An example rollforward command for the 
database test_db, table space ts 1 , dropped table ID 00000000000000b60000 is shown where the flat 
file representation of the table is to be stored in file location /temp/ffile. 

rollforward db test_db to end of logs and stop 

tablespace (tsl) recover dropped table 

00000000000000b60000 to /temp/ffile 

With reference to Figure 1, once the data from the dropped table in pre-drop table space 24 has been 
saved to flat file 26, further transactions 28 may be replayed on pre-drop table space 24 to result in 
recovered table space 30. The dropped table may be redefined in recovered table space 30 by create 
table command 32. The result is intermediate recovered table space 34. Load data command 36 
repopulates the table created by create table command 32 from flat file 26 to create recovered table 
in current table space 38. In this way, the dropped table is recovered in the table space without the 
need to restore the entire database. It will be appreciated by those skilled in the art that although in 
Figure 1 the various table spaces 10, 16, 20, 24, 30, 34 and 38 are shown as separate items, a typical 
implementation of the preferred embodiment uses the same table space for all items, although the 
state of the table space varies over time, as described above. 
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By replaying transactions on the table space only, rather than on the database as a whole, the 
database remains available for use by other users and the time to recover the dropped table is 
potentially shorter. The data fiom the dropped table is stored in flat file 26 to permit the data to be 
recovered into a table space which has different attributes than the table space from which the table 
was dropped. Dropped table history 1 4 includes dropped table characteristics which permit the table 
to be redefined in intermediate recovered table space 34 by create table command 32. 

In SQL commands, the above procedure may be carried out using the following steps. An example 
of how to define the table into which the dropped table data will be copied is the following SQL 
command: 

create table "test "."tablel " ( "coll " integer ) in "tsl H 

The table is then repopulated from flat file ee using a command: 
load from data of del insert into tablel 

As will be apparent to one skilled in the art, there are other variations on the above approach to 
recovering the dropped table, given the system of the preferred embodiment. In particular, the 
recovery of the dropped table may be accomplished by restoring the database as a whole into a 
different system than the first database. The table space can then be restored in the second system 
and the rollforward and recovery of the dropped table carried out "offline". This will permit the 
existing database to be used without making even the table space of the dropped table unavailable 
to users of the system. Another alternative to the steps described above is to make a copy of the 
current table space before carrying out the restore of the table space. Once flat file 26 is created, 
transactions 28 may be ignored and recovered table space 30 may be created by restoring the copy 
of the current table space, rather than by replaying transactions 28 on pre-drop table space 24. This 
alternative approach is advantageous where there are significant numbers of transactions in 
transactions 28. 

As will also be apparent to those skilled in the art, flat file 26 may have other uses, and the data in 
CA9-99-023 . 



CA 02279028 1999-07-29 



flat file 26 may be exported to other applications or used in the database in other contexts than the 
repopulation of the dropped table. 

Although a preferred embodiment of the present invention has been described here in detail, it will 
be appreciated by those skilled in the art, that variations may be made thereto, without departing 
from the spirit of the invention or the scope of the appended claims. 
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The embodiments of the invention in which an exclusive property or privilege is claimed are defined 
as follows: 

1 . A database management system comprising 

one or more table spaces, each table space containing one or more tables having table 
definition attributes, 

means for generating, for a dropped table in a selected table space, a time stamp reflecting 
the time of drop and a unique table identifier, 

a dropped table history means for storing the table identifier, the time stamp and the table 
definition attributes for the dropped table, 

means for restoring and rolling forward the selected table space containing the dropped table 
to the time reflected in the time stamp by replaying a first set of stored transactions up to the time 
reflected in the time stamp, 

means for copying the data from the dropped table in the rolled forward selected table space 
to a storage data structure, 

means for updating the selected table space to a desired current state, 

means for accessing the table definition attributes for the dropped table, in the dropped table 
history means, to create a new table in the table space, and 

means for loading the data in the storage data structure into the new table. 

2. The system of claim 1 further comprising a dropped table flag for enabling dropped table 
recovery for a selected table space whereby the storage of the table identifier, the time stamp and the 
table definition attributes for the dropped table are conditional on the dropped table flag. 

3. The system of claim 1 in which the storage data structure is flat file. 

4. The system of claim 1 in which the means for updating the selected table space to a desired 
current state comprises a user-defined time up to which user-defined time a second set of stored 
transactions after the time reflected in the time stamp are replayed against the selected table space. 
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5. The system of claim 1 further comprising a means for storing a current state of the selected 
table space and in which the means for updating the selected table space to a desired current state 
further comprises a means to retrieve the stored current state of the selected table space. 

6. A computer program product for use with a computer comprising a central processing unit 
and random access memory, said computer program product comprising a computer usable medium 
having computer readable code means embodied in said medium for managing a database 
comprising one or more table spaces, each table space containing one or more tables having table 
definition attributes, said computer program product comprising: 

computer readable program code means for causing a computer to generate for a dropped 
table in a selected table space, a time stamp reflecting the time of drop and a unique table identifier, 

computer readable program code means for causing a computer to create and maintain a 
dropped table history means for storing the table identifier, the time stamp and the table definition 
attributes for the dropped table, 

computer readable program code means for causing a computer to restore and roll forward 
the selected table space containing the dropped table to the time reflected in the time stamp by 
replaying a first set of stored transactions up to the time reflected in the time stamp, 

computer readable program code means for causing a computer to copy the data from the 
dropped table in the rolled forward selected table space to a storage data structure, 

computer readable program code means for causing a computer to update the selected table 
space to a desired current state, 

computer readable program code means for causing a computer to access the table definition 
attributes for the dropped table, in the dropped table history means, to create a new table in the table 
space, and 

computer readable program code means for causing a computer to load the data in the storage 
data structure into the new table. 

7. The computer program product of claim 6, further comprising a computer readable program 
code means for causing a computer to implement a dropped table flag for enabling dropped table 
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recovery for a selected table space whereby the storage ofthe table identifier, the time stamp and the 
table definition attributes for the dropped table are conditional on the dropped table flag. 

8. The computer program product of claim 6 in which the storage data structure is flat file. 

9. The computer program product of claim 6 in which the computer readable program code 
means for causing a computer to update the selected table space to a desired current state comprises 
a user-defined time up to which user-defined time a second set of stored transactions after the time 
reflected in the time stamp are replayed against the selected table space. 

1 0. The computer program product of claim 6 further comprising a computer readable program 
code means for causing a computer to store a current state ofthe selected table space and in which 
the computer readable program code means for causing a computer to update the selected table space 
to a desired current state further comprises a means to retrieve the stored current state ofthe selected 
table space. 

11. A method for recovering a dropped table in database management system comprising one 
or more table spaces, each table space containing one or more tables having table definition 
attributes, the method comprising the following steps: 

(a) generating, for a dropped table in a selected table space, a time stamp reflecting the time 
of drop and a unique table identifier, 

(b) storing the table identifier, the time stamp and the table definition attributes for the 
dropped table in a dropped table history data structure, 

(c) restoring and rolling forward the selected table space containing the dropped table to the 
time reflected in the time stamp by replaying a first set of stored transactions up to the time reflected 
in the time stamp, 

(d) copying the data from the dropped table in the rolled forward selected table space to a 
storage data structure, 

(e) updating the selected table space to a desired current state, 
CA9-99-023 12 
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(f) accessing the table definition attributes for the dropped table, in the dropped table history 
data structure, to create a new table in the table space, and 

(g) loading the data in the storage data structure into the new table. 

12. The method of claim 1 1 further comprising the step of setting a dropped table flag for 
enabling dropped table recovery for a selected table space whereby the storage ofthe table identifier, 
the timestamp and the table definition attributes for the dropped table are conditional on the dropped 
table flag being set. 

13. The method of claim 1 1 in which the step of updating the selected table space to a desired 
current state is dependent on a user-defined time up to which user-defined time a second set of stored 
transactions after the time reflected in the time stamp are replayed against the selected table space. 

14. The method of claim 1 1 further comprising the step of storing a current state ofthe selected 
tablespace prior to restoring and rolling forward the selected table space and in which the means for 
updating the selected table space to a desired current state further comprises the step of retrieving 
the stored current state ofthe selected table space. 

15. A computer program product tangibly embodying a program of instructions executable by 
a computer to perform the method steps of claim 1 1 . 

16. A computer program product tangibly embodying a program of instructions executable by 
a computer to perform the method steps of claim 12. 



17. A computer program product tangibly embodying a program of instructions executable by 
a computer to perform the method steps of claim 13. 

1 8. A computer program product tangibly embodying a program of instructions executable by 
a computer to perform the method steps of claim 14. 
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